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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address -- 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )S Responsive to communication(s) filed on 01 February 2000 . 
2a)D This action is FINAL. 2b)[X] This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
Disposition of Claims 

4) K Ciaim(s) 1-24 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) E3 Claim(s) 1-24 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)D accepted or b)Q objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
1lO The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

1 3) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 

a)dAII b)D Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) 13 Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 

Attach ment(s) 

1 ) [3 Notice of References Cited (PTO-892) 4) O Interview Summary (PTO-41 3) Paper No(s). . 

2) S Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) O Notice of Informal Patent Application (PTO-152) 

3) □ Information Disclosure Statement(s) (PTO-1449) Paper No(s) . 6) □ Other: 
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Detailed Action 

L Drawings have been objected to by the Draftsperson under 37 CFR 1.84 or 1.152, 
correction noted on PTO-948 is required. A proposed drawing correction or corrected drawings 
are required in reply to this office action to avoid abandonment of the application. The objection 
to the drawings are no longer held in abeyance. If reply does not include corrected drawings, 
proposed corrections, or reply to the drawings requirement, the reply would be held non- 
responsive. 

2. The following is a quotation of 35 U.S.C. §103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this title, if the differences between the subject matter sought to be patented and the prior art are such that the 
subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary skill 
in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

3. Claims 1-10 are rejected under 35 U.S.C. 103(a) as being unpatentable over Sezan, et. al. 
(Sezan) MPEG-7 Standardization Activities, ICIP 1998. 

Regarding claim 1, Sezan teaches substantial features of the invention as claimed, teaching a 
system/method for combining, linking and associating multimedia descriptors for efficient means 
for archival and retrieval of multimedia content; 

collected multimedia information content (introduction, page 517); 

generating multimedia descriptors (descriptor, page 518, Fig. 1, description generation) 
for each multimedia features of classified data type (i.e. categorized multimedia), (data defined 
as audio video, text and any other medium, feature, page 518, description categories, page 519); 

using a multimedia description scheme (D, DS, DDL, page 518) to generate description 
for multiple multimedia types particularly audio, video, interface to textual description, and 
combination of these (i.e. multimedia integration description scheme) (applicability, page 519); 

integrated multimedia description code generated from the multimedia integration 
description scheme is stored in a database and communicated to a search engine (left column, 
page 518); however Sezan teachings of generating multimedia descriptors for each multimedia 
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features of classified data type including audio video, text and any other medium, is not called a 
"classification"; 

It would have been obvious to one ordinary skilled in the art at the time the invention was 
made to implement Sezan 5 s teachings to execute claimed invention performing the same 
functions as claimed, motivation would be utilize description definition language based on 
discussed descriptors to generate schemes for database organization for fast and efficient 
retrieval using search engines of MPEG-7 multimedia, as taught by Sezan. 

Regarding claim 2, categories include video (Sezan: wherein media data information(s) is 
categorized as such as audio and/or visual data (i.e. audio, video, text), other media types or any 
combination of these (Fig. 1, and left column, page 519). 

Regarding claim 3, descriptors define multimedia content (descriptors and description, page 
518). 

Regarding claim 4, descriptors include values (Sezan: value, e.g. mood of an image or pitch of 
audio, see features, page 518). 

Regarding claim 5, compatibility MPEG-7 (Sezan: abstract). 

Regarding claim 6, scheme includes video (Sezan: introduction, page 517). 

Regarding claim 7, description scheme are based on description definition language (see DS, 
description, coded description and DDL, page 518). 

Regarding claim 8, providing from a database the integrated multimedia description to a search 
engine in response to a query (left column, page 518). 

Regarding claims 9-10, multimedia represented as hierarchy of object (Sezan: features hierarchy, 
page 519), i.e. and entity relation graph. 
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4. Claims 11-24 are rejected under 35 U.S.C. 103(a) as being unpatentable over Sezan, et. 
al. (Sezan) MPEG-7 Standardization Activities, ICIP 1998 in view of Patel in article, XML: 
Extensible Markup Language, Patel, P., July 1998. 

Regarding claim 11, the above prior art however does not teach wherein descriptors include 
document type e.g. XML; 

Patel teaches wherein descriptor document type include XML, wherein XML and SQL 
are similar in (search engines) purpose, SQL is a standardized language categorized into one of 
three broad sections: DDL, DML, and DQL, using DDL to define your data, DQL to query user 
defined data, and DML to manipulate your data. 

It would a have been obvious to one ordinary skilled in the art at the time the invention 
was made to include a document type definition as XML, motivation would be to further extend 
Sezan teaching of using a document type such as SGML, because XML is less complicated than 
SGML, it lets the user develop structured documents similar to SGML documents but removes 
many of the complex, less-used features of SGML, such as complex entity references, XML also 
makes it easier to create document type definitions and share them over the Web, as further 
suggested by Patel. 

Regarding 12, search in response to user's query (Sezan: page 518). 

Regarding claim 13, this claim comprises the system for integrating multimedia descriptions 
discussed above on claim 1, rejected for obviousness under U.S.C. 103, this same rationale is 
also applied to system claim, claimed in terms of function, property or characteristic. 

Regarding claims 14-24, these claims comprises the system for integrating multimedia 
descriptions discussed above on claims 2-12, respectively, rejected for obviousness under U.S.C. 
§103, this same rationale is also applied to system claim, claimed in terms of function, property 
or characteristic. 
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Citation of Pertinent Art: 



The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure; Copies of documents cited will be provided as set forth in MPEP§ 707.05(a): 

Ref A: Multimedia content description in the InfoPyramid, Chung-Sheng Li; Mohan, R.; Smith, 
J.R, Acoustics, Speech & Signal Processing, IEEE Conference, 12-1 5 May 1998, ACM ISBN: 0- 
7803-4428-6, pages 3789-3792. 

Li et. al. teaches Disclose generating multimedia descriptors, the descriptors describe 
multimedia content from multimedia categories such as image, audio, video, synthetic, text and a 
combination or synthesis of theses categories, the descriptors include descriptor values associated with the 
features or characteristics of said multimedia content. Descriptor along with the descriptor values may be 
combined using the multimedia description scheme, how these elements are combined (i.e. integrated) in 
a multimedia presentation (scenario), wherein the scheme is based on a description definition language. 
The description scheme is compatible with MPEG-7. The code generated by the multimedia description 
scheme is used for efficient user query formation and processing using search engines-based queries. 

Ref B: MPEG-7: Context and Objective, version 10, ISO/EEC JTC1/SC29AVG11 N2460, 

MPEG98, Oct. 1998, pages 1-11. 

Disclose generating multimedia descriptors (Figs. 2-4), the descriptors describe multimedia 
content from multimedia categories such as image, audio, video, synthetic, text and a combination or 
synthesis of theses categories, the descriptors include descriptor values associated with the features or 
characteristics of said multimedia content. Descriptor along with the descriptor values may be combined 
using the multimedia description scheme, where audiovisual material that has MPEG7 data is associated 
and indexed and searched for, such as images, graphics, 3D models, audio and describes how these 
elements are combined (i.e. integrated) in a multimedia presentation (scenario) or links to other relevant 
multimedia, wherein the scheme is based on a description definition language. The description scheme is 
compatible with MPEG-7. The code generated by the multimedia description scheme is used for efficient 
user query formation and processing using search engines-based queries. 
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Any inquiry concerning this communication or earlier communications from the 

examiner should be directed to Prieto, B. whose telephone number is (703) 305-0750. The 

Examiner can normally be reached on Monday-Friday from 6:00 to 3:30 p.m. If attempts to 

reach the examiner by telephone are unsuccessful, the Examiner's Supervisor, Mark H. Rinehart 

can be reached on (703) 305-4815. The fax phone number for the organization where this 

application or proceeding is assigned is (703) 308-6606. Any inquiry of a general nature or 

relating to the status of this application or proceeding should be directed to the receptionist 

whose telephone number is (703) 305-3800/4700. 

Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 



or Faxed to: 

(703) 746-7239, for Official communications and entry 

Or: 

(703) 746-7240, for Non-Official or draft communications, please label 
"PROPOSED" or "DRAFT". 
Or Telephone: 

(703) 306-5631 for TC 2100 Customer Service Office. 



Hand-delivered responses should be brought to Crystal Park n, 2121 Crystal Drive, Arlington. 
VA., Fourth Floor 

(Receptionist), further ensuring that a receipt is provided stamped "TC 2100". 



B>Pfieto 
GAU2142/TC2100 
Patent Examiner 
October 17, 2002 





MARK H. RINEHART 




